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ABSTRACT 



The Maine Educational Assessment (MEA) has provided data to 
inform curriculum and instruction in Maine's schools for 16 years. The test 
results, student questionnaire data, and associated professional development 
opportunities have had a major impact on improving instruction, particularly 
in English language arts (ELA) . In 1997 the legislature approved the Maine 
Learning Results- -standards in eight content areas which form the framework 
for curriculum in Maine. Now that the MEA has been aligned with "Learning 
Results," the resulting data on student achievement can be used more 
comprehensively to plan classroom, school, and district improvement 
strategies. Students in grades 4, 8, and 11 in all public schools in the 
state participate in the MEA. The ELA section consists of a reading, writing, 
and a reading/writing segment, in which students respond to multiple choice, 
short answer, and constructed response questions related to reading passages. 
They also complete a writing sample based on a common prompt. Teachers score 
the writing prompt and evaluate the writing samples. State consultants 
provide regional workshops to review what was received and how to read the 
information. Includes sample data. (NKA) 
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Using Data to Inform Instruction - Stories from five 
States 

Maine, the Way Life Should Be 
Karen Rumery, Maine DOE 

The Maine Educational Assessment (MEA) has provided data to inform 
curriculum and instruction in Maine’s schools for sixteen years. The test 
results, student questionnaire data, and associated professional 
development opportunities have had a major impact in improving 
instruction, particularly in English Language Arts. 

In July of 1997, the state legislature approved the Maine Learning Results. 
These standards, in eight content areas, form the framework for 
curriculum in Maine. The legislation also stipulated that the Maine 
Educational Assessment continue and be aligned with the learning 
results. Maine is entering the third year of the “neo-MEA”, aligned with 
Maine’s Learning Results. We continue to provide professional 
development opportunities focused on informing curriculum, instruction, 
and assessment in the classroom. 

Nov; that the Maine Educational Assessment (MEA) has been aligned with 
Learning Results , the resulting data on student achievement can be used 
more comprehensively - along with data generated at the local level - to 
plan classroom, school, and district improvement strategies. Our goal is 
to create an organizational culture that values accountability grounded in 
data analysis, and to provide this community with assistance and 
opportunity to develop common language and assessments through 
shared events regionally. 

Students in grades 4, 8, and 11 in all public schools in the state participate 
in the MEA. It is administered in 2-sessions: Fall (ELA and Health and 
Physical Education); Spring (Math, Science and Technology, Social 
Studies, and Visual and Performing Arts). 

ELA consists of a reading, writing, and a reading/writing segment. 
Students respond to multiple choice, short answer, and constructed 
response questions related to reading passages. In addition, they 
complete a writing sample based on a common prompt and a 
reading/writing sample based on a passage and scored for both reading 
and writing. 

Maine teachers score the common writing prompt at each grade level in 
state. It is this professional development opportunity that has significantly 
influenced the improvement in writing for the state. Teachers from 
throughout the state come together for 3-days to not only evaluate student 
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writing samples, but to network with colleagues and examine the work of 
students from many settings and groupings. The question of what is good 
writing and how good is good enough is debated and determined through 
benchmarking activities using a scoring rubric and live student papers. 

Teachers completing surveys at recent scoring sessions indicate that the 
experience with MEA scoring is an assist for them in the classroom and 
within their schools and districts. When asked what described their initial 
motivation to attend a scoring session, the majority replied that improving 
classroom assessment was their primary reason. 

Teachers have continued the learning from these scoring sessions within 
their own schools and districts. Schools throughout the state adopt the 
scoring rubric and students understand what they need to do to improve 
their writing. 

With the revised MEA the results are not simply numbers, but actual 
student work is returned to districts to enhance the understanding of why 
a particular score was earned. 

Building on the success of the in state scoring of writing, Maine completed 
a sample scoring of student constructed responses in reading, science 
and technology and physical education, social studies, math, health, and 
visual and performing arts. Although we have not been able to continue 
this work at present, we are hopeful that teacher scoring will become the 
rule for more than ELA’s writing segment. 

Students, teachers, and principals complete questionnaires related to the 
overall assessment as well as specific items related to content. These 
provide interesting findings that influence curriculum, instruction, and 
assessment. 

While all districts and schools are provided with complete reports for their 
schools and classrooms, the question of what this information is really 
telling schools is another professional development opportunity for 
teachers and administrators. The state consultants provide regional 
workshops to review what was received and how to read the information. 
These sessions encourage classroom teachers, schools, and districts to 
mine the information received and to use it to inform their own 
assessments and curriculum planning. Schools receive a CD containing 
all student common writing samples. Schools are also provided with sets 
of released common items from the MEA. 

Schools in Maine are truly becoming “excited about data”. Maine schools 
and school districts are responsible for creating local comprehensive 
assessment systems to align with the Maine Learning Results. The MEA, 
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although a small part of the overall system, has a track record that is 
helping to provide evidence and opportunity for teachers and districts 
throughout the state. 
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With sincere apologies to fellow panel members and audience, I hope the contents of this 
handout will provide adequate information to peak your curiosity and encourage you to 
learn more about “data madness” in Maine. Seriously, we have been and continue to 
engage teachers, schools and districts in conversations and activities around assessment 
to inform teaching and learning. Our state assessment, the Maine Educational 
Assessment (MEA), is but one piece of a developing Comprehensive Assessment System. 

For more information, contact: 

Karen Peverada Rumery 
Maine Department of Education 
23 State House Station 
Augusta, ME 04330-0023 
207 287-5985 
fax 207 287-5927 
karen. rumervdstate. me. us 



Additional information: 

^ sample released items 
A sample school/district report 
A sample class report 
A sample questionnaire items 
A sample findings from analysis 



Released items and connections: 

The released items are from the grade 4 ELA reading section — 

The items correspond to the class report as numbers 10-14. The classroom teacher can 
determine how each individual did on an item as well as the whole class, school, and 
district view. Using the released items, the teacher can determine which content 
standards and performance indicators were assessed and whether they were addressed in 
class. Implications for teaching and learning begin to unfold. 

The school/district report places the school in relationship to other schools in the district 
as well as the state. Performance levels are based on the body of work, but the 
breakdown of standards within a content area indicates the distribution of points within 
that area. Thus the example of ELA shows standards A and C reported together and B 
and D reported separately. 

The questionnaire is a sampling of the types of questions asked to arrive at the sampling 
of findings from analysis. This is statewide data, but provides good information to 
provoke questions and research. 
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THE FASTEST KID IN THE FIFTH GRADE 

(from Bridge to Terablthia by Katherine Paterson) 

At the bang Jess shot forward. It felt good — even the rough ground 
against the bottom of his worn sneakers. He was pumping good. He 
could almost smell Gary Fulcher's surprise at his improvement. The 
crowd was noisier than they'd been during the other heats. Maybe they 
were all noticing. He wanted to look back and see where the others were, 
but he resisted the temptation. It would seem conceited to look back. He 
concentrated on the line ahead. It was nearing with every step. "Oh, 

Miss Bessie, if you could see me now." 

He felt it before he saw it. Someone was moving up. He 
automatically pumped harder. Then the shape was there in his 
sideways vision. Then suddenly pulling ahead. He forced himself 
now. His breath was choking him, and the sweat was in his eyes. 
But he saw the figure anyhow. The faded cutoffs crossed the line 
a full three feet ahead of him. 

Leslie turned to face him with a wide smile on her tanned face. 
He stumbled and without a word began half walking, half trotting 
over to the starting line. This was tire day he was going to be 
champion — the best runner of the fourth and fifth grades, and he 
hadn't even won his heat. There was no cheering at either end of 
the field. The rest of the boys seemed as stunned as he. The teasing 
would come later, he felt sure, but at least for the moment none 
of them were talking. 



9 , 

ERIC 



ME A RELEASED ITEMS r- DECEMBER 1999 ASSESSMENT - GRADE 4 



13 




12. Jess is the kind of person who 



10. Who is the main character in this 
passage? 

O A. Jess 

O B. Gary Fulcher 

O C. Miss Bessie 

O D. Leslie 



O A. is afraid. 

O B. wants to win. 

O C. is always happy. 

O D. wants to be mean. 



11. The term “sideways vision” means 
seeing 



o 


A. out of the comers of your 




eyes. 




o 


B. when you 


turn your head to 




the side. 




o 


C. objects in 


black and white. 


o 


D. the sides 


of people's faces. 



13. In the second paragraph the author refers to Leslie as “someone.” Name two other 
ways the author refers to Leslie in the second paragraph. 
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14. Describe how Jess’s feelings about the race change from the beginning of the race 
to the end. Use details from the passage to support your answer. 
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13. In the second paragraph the author 
refers to Leslie as “someone.” Name 
two other ways the author refers to 
Leslie in the second paragraph. 



SA#: 13 

Learning Results: A-5 

Process of Reading . . . 4 

A Students will use the skills and strategies of the reading process to comprehend, interpret, 
evaluate, and appreciate what they have read. Students will be able to 
5 read a variety of narrative and informational texts independently and fluently. 



THE FASTEST KID IN THE FIFTH GRADE 

SHORT-ANSWER SCORING GUIDE 



Score 


Description 


2 


Response correctly identifies two other ways the author refers to Leslie in 
the second paragraph (i.e., it, the shape, the figure, the faded cutoffs). 


1 


Response correctly identifies one other way the author refers to Leslie in 
the second paragraph. 


0 


Response is totally incorrect or irrelevant. 


Blank 


No response. 



0 
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14. Describe how Jess’s feelings about the 
race change from the beginning of the 
race to the end. Use details from the 
passage to support your answer. 



CR#: 14 

Learning Results: B-10 

Literature and Culture . . 

B Students will use reading, listening, and viewing strategies to experience, understand, and 

appreciate literature and culture. Students will be able to ... 

10 apply effective strategies to the reading and interpretation of fiction (e.g., fantasies, 
fables, myths, mysteries, realistic and historical fiction, adventures, and humorous 
tales) that is appropriately complex in terms of character, plot, theme, and dialogue 
and appropriately sophisticated in style, point of view, and use of literary devices. 



THE FASTEST KID IN THE FIFTH GRADE 
CONSTRUCTED-RESPONSE SCORING GUIDE 



Score 


Description 


4 


Response demonstrates an insightful understanding of the character’s 
feelings and includes strong support from the text. 


3 


Response demonstrates an understanding of the character’s feelings. 
Textual support may lack some specificity or development. 


2 


Response demonstrates a partial understanding of the characters feelings 
with incomplete support from the text. 


1 


Response demonstrates a minimal understanding of the characters feelings 
with vague support from the text. 


0 


Response is totally incorrect or irrelevant. 


Blank 


No response. 




Training Notes for Constructed-Response #14 



Score 


Description ^ 


4 


Response provides a thorough description of how Jess’s feelings change 
from the beginning to the end of the race (see below). Explanation is 
well-supported by details in the passage. 


3 


Response provides an adequate description of how Jess’s feelings change 
from the beginning of the race to the end, but lacks some supporting 
details. 


2 


Response provides a partial description with support or provides a weak 
description of the change of his feelings. 


1 


Response provides a vague statement about the race. 


0 


Response is totally incorrect or irrelevant. 


Blank 


No response. 



Thorough description may Include (but not necessarily be limited to) the following 
details 

Paragraph 1 At the beginning of the race Jess felt confident/good. 

Paragraph 2 At the middle of the race Jess became concerned/worried/nervous. 

Paragraph 3 At the end of the race Jess felt defeated/humiliated/upset/stunned. 

A score point 1 should be reserved for those responses that are brief and show no awareness at all 
of a change in Jess’s feelings. If responses convey an awareness of the change in feelings, they 
may receive more than a 1 even if there is a reliance on retelling. 
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SUMMARY OF SCORES 
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A Sampling of interesting findings from the Analysis of the 1999-2000 school year 
results of the MEA: 

EL A - reading and writing 

V 89% of grade 4 students report having read two or more books at home in the two 
months prior to testing. 

V 56% of grade 4 students report having read 5 or more books at home in the two 
months prior to testing. These students are more likely to Meet or Exceed 
standards (48% compared to 35% for those who only read one book). 

y 51% of grade 4 students report reading 1 1 or more pages daily of in-school or 
homework assignments. These students are more likely to Meet or Exceed 
standards in reading than students who read fewer pages (52% compared to 34% 
of students reading 5 or fewer pages). 

y 75 % of grade 1 1 students report using a computer to search for and read 
information once a week or more. These students are more likely to Meet or 
Exceed standards in reading (50% compared to 23% of students who never use a 
computer search). 

y 94 % of grade 1 1 students report using a computer to produce the final draft of 
written assignments. 

y 49 % of grade 1 1 students report receiving grammar instruction primarily through 
written comments on their papers. These students are more likely to Meet or 
Exceed standards in writing than those receiving other types of instruction (39% 
of students compared to 31% or fewer in other modes of instruction, such as mini- 
lessons, grammar textbooks, and individual instruction during writing 
conferences) 

y 36% of grade 8 students report keeping a collection of their writing and using it to 
grow as a writer. These students are more likely to Meet or Exceed standards in 
writing (36% compared to 16% of students not keeping a collection of their 
writing). 
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